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As part of a one-year trial project, in fall 1981, 
Oakton College students who scored below 35 v on the Educational 
Testing Service Test of Written Expression were not permitted to 
enroll in C101 (an introductory communications course) until they had 
successfully completed a developmental communications course or had 
retaken and passed! the exam. To assess this mandatory placement 
policy, all sections of fall 1980 and fall 1981 C101 courses- were 
compared with respect to grade distribution and course completion 
rates. Individual student scores on the Test of Written Expression 
(TWE) and the Nelson-Denny Reading Tests (NDRX) were correlated with . 
measures of academic performance, such as grades in communications 
courses and grade point "average (GPA) . The study revealed that: (1) 
under mandatory placement, a higher percentage of enrollees in C101 
successfully completed the course than un<3er advisory placement 
procedures used the year before; (2) TWE scores were not 
significantly correlated to student course grades or overall GPA, 
while NDRT scores were strongly correlated to course grades; (3) NDRT 
total scores (which combined vocabulary and reading comprehension 
scores) were strongly related to students 9 GPA 9 s for courses other 
than communications courses; and (4) grades in C101 were not related 
to grades in other courses. Based on the finding's, recommendations to 
use the NDRT fpr placement and to track subsequent performance in 
developmental courses were made. (KL) 
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Executive Summary 



Assessment of Mandatory Placement in Communications 

Fall 1981 * 



Introduction: 



In fall 1981 students scoring below 35 on an ETS writing 
testxere prohibited from enrolling In communications 101. 
As part of a one-year trial for this mandatory placement 
policy it was agreed an assessment of mandatory placement 
would be made. 



Methodology: 



Two units of analysis^were used. 



Findings: 



1. All sections of communications 101 iri fall 1980 and ^n 
•fall 1981 were compared relative to grade distributions 

and percentage of students obtaining credit In the » 
course. 

2. Individual students 1 scores on placement tests were 
associated with a variety of variables measuring 
academic performance and retention (e.g., grades Jn 
communications courses, grade-point averages, 
percentage of courses completed). 

In the fall of 1980 32% of students were advised not to 
enroll in communications 101 . 

In the, fall of 1981 402 of students who took placement 
tests were not permitted to enroll in communications 101. 

*^ 

Students who enrolled in communications 101 in the fall of 
1980 who had been advised not to, and who stayed in the 
course beyond midterm, did as well as students advised into 
communications 107 in the first place. 

^significantly higher percentage of students Intltlafly 
enrolled In communications 101 under mandatory placement 
completed the course for credit compared. to those enrolling 
under voluntary "placement (80% and 59%, respectively) 

53% of the students enrolling In developmental 
communications in the fall of 1981 successfully completed 
the course. 



There Was no differenc e in mean ETS scores _aniong-Students- 

whoTtn-the-farroTT98r V < 

—did not enroll at Oakton at all 
--did not enroll in communications courses 
—enrolled in communications courses 



'Students who scored 35 or above on the ETS In fall 1981 
were more likely to complete all of their courses, and Tess- - 

llkel y to~c«npl ete-only-one-quarter of-themrH:han-students 

scoring 34 or below. . 

* s " " • 

The ETS score Is not significantly related to students' 
grades in communications 101 or grade point average in . 
Other courses. . , : ;' - 

The Nelson-Denny Total score fs strongly related to 
students' grade point averages, for courses excluding 
communications. 

The Nei son-Denny Reading Test is strongly related to 
stuo'ents^gwde5~l7rcoiiiwn1cat1jpfns™T0TT"~ ; 

No. significant relationship exists between a student's 
grade in communications 101 and grades in other courses. 

Areas of ambiguity in implementing the mandatory placement 
policy exist. Student honor and faculty-initiated checks 
are factors insuring compliance with the policy. 

Mandatory pi aceraent appears to Insure that students, meet 
minimum competency for- enrolling In communications 101. 

Faculty perceive that communications 101 classes are more 
homogeneous in skills under mandatory placement than under 
voluntary placement. , v - 

-Higher success rates (completion of communication 101) are 
attained under mandatory placement than under voluntary 
placement. - 

Students enrolled In communications 051 in the fall of ,1981 
should be tracked to assess their performances in 
communications 101 and in other courses. 

Faculty may wish to consider eliminating the ETS as a 
placement test and using the Nelson-Denny or another 
reading test Instead. 

Faculty and the Admissions Off ice may, wish to explore 
tightening the registration procedure to include a 
prerequisite check, prior to confirming enrollment In 

cpmmujnjcatlo,ns_101. — 

A 

Faculty may wish to review whether a student must earn a T 
In communications 051 prior to enrolling in 101. 

\ * 

" ' \ ; * 

' \ - • 



Assessment of Mandatory. Placement In Communications 
. Fall - 1981 V 

■ p— 

In the fall of 1981 Oakton College Instituted a policy that a student 
scoring below a specified level on a communications (writing) placement 
examination would not be allowed to register in the college credit 
introductory communications course until s/he successfully completed 
.developmental communications or retook thepTaceinent-te"sVand-scored-at or 
above the designated level* The policy was Instituted on a one-year trial " 
basis. As part of the agreement an assessment of the effects of mandatory 
placement was conducted. This report contains the assessment. 

. • "" .- . «• ' % ■ 

10 : . . • 

Units of Analysis and Data Base .. . e ' 

Two units of analysis are used in this study. The first unit of analysis 
is the Iwlivldjiaf^student. Data about Individual, students are drawn from 
several sources. Random samples of 278 students who took placement » * 
examinations for the fall of 1980 and 133 students who too* placement tests 
for the fall of 1981 were selected.* Additionally some data for all students 
taking placement tests for the fall of 1981 are available. 

* Data for all placement test- takers for 1980 are not readily available. 
During T980-8T~the-278~studen1rsampTe"was drawn so that descriptive data about 
the population of test-takers could be generated. The 1981 sample was drawn 
to allow for intensive analysis over several semesters rather than to generate 
descriptive data only. The differing purposes and the fact that the two* 
samples are not directly compared make their differing sizes irrelevant.- Put 
another way, the only data about fall 1980* placement test-takers are from the 
1980 sample. 1 



In 1980 a. student scoring 22 or below on the Educational Testing Service's 
Test of Written Expression was advised to take communications 051. In 1981 
faculty added' items to tne tu> test ?nd raiseo*~tne~spee1 f led score ^tor 34 or — 

O A' 

below. A student scor1ng_34 or. below In 1981 was In theory prohibited from 
enrolling In communications 101, "unless the student had passed communications 
051. 



^s-the-second-unlt-of-anal^sl^-each-coinmunlcatlons-ciasrr that -Is-, each 
section of communications 101, Is considered. Comparisons of grade 
distributions and completion rates before and after the Introduction of 
mandatory placement are made. Comparisons are made between fall 1980 
communications classes (prior to mandatory placement) and fall 1981 
communications classes (after mandatory placement). 

.. .: ' ■ . • 

• " * * * " • 

* «* 

Enrollment In Communications 101 - Fall 1981 

0 o ' — " V, ® 

Although the rnanoatory placement policy appears to clearly specify who 
could enroll In communications 101, analysis of the Implementation of the 
• pol 1 cy reveal s several ambiguous areas , 

Data collected. by the Learning Laboratory Indicates that of students 
■ "\ ^ V *. - • \i 

enrolled In communications 101 In the fall 1981 term, 31% had scored below the 

designated ETS cut-off point and 24XTiad not been tested at all. However, 

data were not collated to Indicate how many of these students had completed 

051 and therefore met the placement policy specifications. 
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Although the placement policy Indicates a student must pass 051 or earn an 
appropriate score on the placement test, in reality no uniform check 1s used 
JtOL-insure_that_ the_forjner_ w.<^1 rement Jias_bj»ii_met. _ Students frequently 



enroll for the next term during the current term and do not know what their 

\ 

current grades will be. Those students enrolled in 051 may In good faith x 

. - > 

register for 101, yet fa1T to earn a T In 051. Other students may simply 

h ' ■ ■ 

enroll in 101 even though they know they will not earn a T 4n 051. 



Communications faculty can ask 101 students 1f they have completed 051, 
and a few faculty check students' transcripts with the Admissions Office. For 
the most part, however, 1t appears that the Implementation of the .051 

requirement is left to the honor of the students and the choice of each 

. i * ■ — 

instructor. r 

Figure 1 outlines the various paths by which a student can enroll 1n 
..communications 101. As Indicated, there are several possibilities, denoted by 

- > I 

a question mark in the terminal, box, for which clear and consistent 
applications ^pf the policy do not exist. ° ' • 

As a verification of placement test results each student enrolled in 
communications 051 and 101 writes a brief essay the first week of class. 
Faculty use these writing samples to confirm the student's initial placement, 
to recommend transfers from 051 to 101, or to require transfers from 101 to 
051. Only four students were recommended from 051 to 101, and only 10 were 
required to transfer to 051. Thus, although it is unclear how many 



7- 
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• communications 101 students actually complied With the mandatory placement 
jralfcy (had completed 051 or scored above 34 on the test) the very small 
number of required transfers back to 051 suggests-jhat t^e vast majority of 
students enrolling In the- qourse did meet minimum standards. In other words, 
the^ombl nation of requiring testing, 051, and/or 2 flrstweek writing sample, 
produced a communications 101 enrollment In compliance with the policy and 
faculty perceptions of m1nimal_competence for entering 101 



Student Performance , 

Voluntary Placement - Fall 198j) 

In 1980 the mean score on the ETS exam was 25, arid the median was 26.' 
Thirty- two percent of test takers scored 22 or below and were advised to take 
communications 051 rather than communications 101. Barely one-half (53%) of 
those who enrolled In a communication course and scored 22 or below accepted ' 
the 051' recommendation. Twenty-three percent of all enrol lees In 
communications 101 had been advised to take communications 051 Instead. 
Seventeen percent of communications 101 a student who received grades of A, B 
or C In the fall of 1980 would not. have been permitted Into the course If 

mandatory placement had been in effect, and slightly more communications 101 

i . , - 

students who scored 22 or below, on the te,st received'Rs or Ns In 

\ *■ ■ « 

' 1 r 
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communications 101 than would have occurred by chance alone. "In other words, 
once enrolled In communications 101 students advised not to take the course 
did nearly as) well as. those who scored above the cut-off p'oint if the student 
stayed in c^ass until midterm {see below). " 



x 



i 
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^. Mandatory Placement - Fall 1981 . , 4 



;,/;> 



In the fall of 1981 a total of 1375 individuals took communications . 
placement exams. The mean and mldian scores were 36 (recall that -additional 
Items on the 1.981 tests raised the total point, score possible.) Forty percent 
of students scored 34- or below; i.e., were not permitted to register In ' 
communications 101. 



A random sample of 133 individuals who took communications placement tests 
for the fall of 1981 was selected for Intensive analysis. Of the sample, a$ 
but four took, the ETS examination. Forty-seyen percent of the sample were' 
male, fifty three percent were female; the average "age was 27, with 832 for 
• whom data were available being 'age 24 or below. 



\ 



\ 



•X 



Of the 133 individuals "in the sample, 26 (20%) enrolled In no courses at 
Oakton in. the fall term or dropped all their courses prior to midterm. Their 
mean ETS score was 35.1 Of the remaining 107 people, 24 (22%) enrolled in 
communications 051, 57 (53X) enrolled in communications 1.01, and 26 (24S) 
enrolled In neither cdurse. The mean ETS score for those enrolled at Oakton 



0 
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r 



but not taking communications' was 36.2; 62% of .these people were eligible to, 
take communications 101. Only 6 Individuals enrolled In communications 001, 
Reading. 



One hundned^twenty eight Individuals In the sample took the Nel son^Denny x 

1 summa 

\ 



Tests. Table 1 summarizes their scores. Mean scores are at high .school 
levels, while- the percent scoring/ at college: levels ranges from 36 to 48. 



Seven stui 



students completed commu»fcat1ons 051 wfth the grade T. v The other 

' \ . . " * 

17 either' dropped the course Gr received airR. • Comparable, figures for all 

students enrolled In communication? 051, "Indicate 53% *-cce1ve<? a T' grade. The 

. . . - . 
grade distribution for those taking communclatlons lOl -Is presented In Table 

2. It Is closely In line with grade distributions for all students In 

communications 101 classes.* 

• * " +\ : 

* * r 

,. " , # i 

Students in the sample enrolled- in from one to seven courses In the fatl 
termj with 28% enrolling In three or fewer and 60% enrolling In four or five. 
'To assess the as'socatlon between 'ETS scores and course completion ratios, the 
percentage 'of courses successfully completed Jby each student was; calculated. 
These percentages were then compared, between two groups'; those obtaining an 
ETS score of 34 or below, and those scoring 35 or above. Results are 
presented In Table 3. Although differences are not statistically significant, 
a pattern is revealed.. Students who score less than .35 are more likely to 
complete one-quarter or fewer of their courses, while those who score 35 or 
'■above <are more likely to complete all of their courses. There was no 
significant association between ETS scores and the receipt of X or R grades. 
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♦ * 
"• \ To further fnvesti gate the association between the ETS score and academic 

performance' several other calculations were made as well. Students grade 

point averages for fall 1981 courses excluding communications were 

calculatedr^he^PAJmeWwas 2757, with a standard deviation of .85. This. * 

• .* . 
means that 66% of students earned a GPA, excluding communications, between 

1..72, or roughly C-/D+, and 3; 42, or;B+. • * 



The correlation' between^th'e_EIS^scbce-^nd thl s GPA-was-negl iglble: -1e'ss J 



than 2X x of the variance In GPA was explained 'by ETS score (r«.ll). The single 
, variable whjch Is most powerful in predicting GPA is a students total score»on 

* the Nelson Oenny Test; 29X of the GPA. variance Is explained by the * 

t 

Nelson-Denny Total (r*.54) * 

/ ' • ' ' • 

The correlations between ETS 5 score, Nelson-Oenny scores, and grades " J 

i 

received In communications 101 were also calculated... The ETS score explains 
none of the variance In grades received for those who earned credit In 
Communications 101. The Nelson-Oenny reading test, on the other hand,, 
explains 41% of the variance In grades in communications 101 ; "* 

> * I T* 

Finally, the correlation between the grade in communications 101 and GPA 

• . * . 

without communications was calculated. The correlation was .25,< meaning 'that 

there Is minimal relationship between the grade 1n communications 101 and In 
- other courses. \ 
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Class Performance 



. As of the tenth day enrollment count,' 1009 students' were enrolled In 44 
-sections of communlcations-Wl 1n the -fall of 1980. . Forty-s1x~sectlt>ns t>fr~ 



communicatlons 101 fti fall 1981 /contained 1007. students. The distribution of 
grades A, B, "C, and Djrfaj roughly the same, In the two terms. However, In fall 
1980,_ before Jiandatpry placement, 41 X of students, enrolled as of the tejith day 
fa11ed~to~fece1ve credit In Communications 101 at the end of the term'. That 



.Is, only 5§X of course enrol lees earned grades of1^~B7~tr"or~br^omparabl 

* * • - s • ■ 

figures for 1981 a with mandatory placement, Indicate only'20X of students 

***** \ 

, failed, to obtain passing grades at the end of ttwterm. In other words, under 

* $ * * \ \ ~ 

mandatory placement a significantly higher percentage of enroll ees in- f * 

.communications, 101 successfully complete the course- than uiWer a system of * 

advisory placement . > : , • 

r — — 

Conclusions « ' * 

* * * 1 a * 

Based on evidence presented in the study and faculty responses to a survey 
. in* the fall of 1981, it appears that un.der mandatory placement a higher ' 

percentage, of. enrol lees in comnunl cations 101. successfully complete the course 

.♦ 

•than under voluntary placement, and faculty perceive their 101 classes to be 
more homogeneous In the past. The small number. of transfers between 

1 i » t 

communications 101 and 051' suggests that students enrolled in 101 meet minimum 
standards .of competence necessary for entering that course. , x 




Recommendations 



Recommendations Include the following: 



Students enrolled 1n communications 051 In the fall of 1981 should be 
tracked to assess their performances 1n communications 101 and 1n other 
courses. - , *, 



Faculty may wish to consider eliminating the ETS as a. placement test and 
using the Nelson-Denny or another reading test Instead. 

Faculty^and the AdmiWrons Office may wish to explore tightening the 
registration* procedure to Include a prerequisite check prior to confirming 
Enrollment 1n communications 101... 



Faculty may wish to review whether a student must earn a T In 

... ' ■ . • . ' • V ' - •■" 

communications 051 prior* to enrolling 1n 101.. * *. 




Table 1 

Nelson-Denny Scores of 1981 Sample 



Mean Score 1 Standard Deviation Percent at College Level 



Vocabul ary 


12.2 


2.6 


48.4 


Comprehension 

• 


11,2 


2.9 


35 * ' 


Total 


, n.7: 


2.5 • 


43. f 


Reading 


10.6 , 


3.5 


35.5 



v 



/ 
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Table 2 

Grade, Distribution of Students Who Took Placement Tests - 
Communications J 01.. - Fall 1981 1 



Grade 


N 




A 


15 


25.> : v ^||t? 


B 


23 


3970 


C 


10 


16.9 


D. 


1 


1.7 


X 


1 


1.7 


R 

* ***** 


3 




Withdraw v 


6 - 


10.2 



*~ • . • 

1 Data are drawn from 1981 sample; percentages are general izable to 
population of students who took pi acemefif tests and enrolled in communications 
101. 



Table 3 

ETS Score and Percent of Courses Completed - 
Students Who Took Placement Tests - Fall 1981 



Percent 
Courses 
Completed 


0-25 


33-50 


60-80 


100 




- ETS 
1-34 < 


19 
(36) 


10 ' 
(19) 


10 

-(19) ' 


14 
(26) 




35+ 


. 19 
(25) 


/ 
12' 

(16) \ 


14 
(19) 


30 
■ (40) 





X* = 2.95; df » 3; p>.05 . " ~> 

• ~ - •& 

Numbers in parentheses are percentages of those In each ETS category who 
completed this percent of courses. Percentages are general Izable to 
population of students who took placement tests. 



Figure I 

Path of Student Enrollment in Communications 101 



CM 
CO 



Enrolls In 



Co— i mlcatlons 



Student enters Oakton 



Takes Placement Test 



v above 34 } ' 

> - > 




/ * . 




Enrolls In 101 








Fails to complete 051 



n 



Enrolls In 051 



*««sea 




Enrolls In 10 I 



ERIC . 




& s 

o. 

3 3 

< 2 

3 5 

W 2 

O 5 

CO * 



C3 

8' 



if 

?? 3 3 

w ca « 

p-il 
y s 3 



id 

:=> w _ 

^ a 



si * 



-Enrolls In 10 i~ 



IS 



Scores below 35 



t-^ ii. 



based an first week writing sample 



? 



